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4 
ABSTRACT 


This paper will primarily focus on tying public relations programs to business results. It 
examines how a variety of organizations have used PR measurement systems to 
demonstrate the business outcomes of their efforts. Its purpose is to encourage the use of 
data-driven decision-making within the PR profession. It considers the setting of 
measurable goals and objectives and provides six case studies from the technology, 
defense, retail, airline, utility and healthcare industries in which research has been used to 
further business goals and communications objectives. 


INTRODUCTION 


Measurement and evaluation continues to be one of the hottest topics among PR 
professionals today. There isn’t a professional communicator around who hasn't heard the 
demand for accountability. The problem is that most people worry more about “how” to do 
the measurement than about “what” to do with the results once you have them. 


Measurement implies a judgment - and implicitly evokes fear in many practitioners - can I 
“measure up” — will my results be held against me?! We suggest that you remove the term 
“measurement” from the equation altogether, and replace it with “data-driven decision- 
making.” Focus on “getting data with which to make better decisions” rather than simply 
judging your prior performance. Making decisions based on data saves time and boosts your 
credibility. 


When faced with tough decisions, you'll never find your board of directors or CEO relying on 
hunches or gut instinct. Chances are any decisions made at the highest level of your 
company will be made following extensive research. So why should public relations and/or 
corporate communications be any different? How credible would your CFO be if he got up in 
front of the board and said, “I know we’re making money because I see checks coming in?” 


Just as the CFO relies on data to give advice and make recommendations, you need data to 
decide where, when and how to allocate resources. 


SETTING THE STAGE - DEFINITIONS 


It all starts with deciding what you need to know. Having clear, precisely defined goals and 
objectives, and making them measurable, is the first step to any research program. But 

before we address goal-setting, let’s look carefully at the types of results you can hope to 

achieve through public relations. They are categorized very clearly in The Dictionary for 
Public Relations Measurement and Research’ as follows: 


= Outputs - what is generated as a result of a PR program or campaign that impacts 
on a target audience or public to act or behave in some way ... the final stage of a 
communication product, production, or process resulting in the production and 
dissemination of a communication product (brochure, media release, Web site, 
speech, etc.); the number of communication products or services resulting from a 


! “The Dictionary for Public Relations Measurement and Research” by Dr. Don Stacks of the University 
of Miami, available through the Institute for Public Relations, www.instituteforpr.org. 
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communication production process; the number distributed and/or the number 
reaching a targeted audience; the dependent variable in research. 


Outtakes - measurement of what audiences have understood and/or heeded and/or 
responded to a communication product’s call to seek further information from PR 
messages prior to measuring an outcome; audience reaction to the receipt of a 
communication product; recall and retention of the message embedded in the 
product; and whether the audience heeded or responded to a call for information or 
action within the message; the dependent variable in research. 


Outcomes - quantifiable changes in awareness, knowledge, attitude, opinion and 
behavior levels that occur as a result of a public relations program or campaign; in 
effect, the consequence, or impact of a set or program of communication activities or 
products, and may be either short-term (immediate) or long term; the dependent 
variable in research. 


Typically, PR practitioners focus on generating and measuring “outputs” because they’ve 
never been trained to think beyond this first step. But outputs only count what you’ve “put 
out there” in terms of effort; they don’t really connect with the real goals and objectives of 
an organization. So, it’s critical to think in terms of how you will achieve “outtakes” and 
“outcomes” with your programs, if you hope to really effect change. 


The chart below provides some great examples of goals, actions, outputs, outtakes and 
outcomes to help you think through how you will build measurement into your overall plan. 
We have also provided an additional, expanded chart in Appendix A with further ideas on 
how to mix and match goals, objectives and measures. 


Typical Output, Outtake and Outcome Metrics’ 
GOAL ACTION OUTPUT OUTTAKE OUTCOME 
METRIC METRIC METRIC has to 
answer “So 
what?” 
Sales Leads | Place product # meetings % awareness | # of requests for 
reviews # of speaking of your information 
Initiate speakers | engagements brand 
program # of blog % 
Proactive blogger | mentions considering 
outreach # of reviews your brand 
# of news % preferring 
releases sent your brand 
# of media 
contacts made 
Employee Conversations How many % hearing Lower recruitment 
Engagement | Meetings with emails went engagement costs 
management, out? messages Lower turnover 
Intranet page, % emails % believing rates 
Email blast opened engagement 
Unique visits to | messages 
intranet page 
Attendance at 
meetings 
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Favorable White paper # meetings % believing # of downloads of 
Positioning program, # of speaking message white paper 
as the most | speakers engagements % agreeing # of referrals 
Trusted, program, blogger | # of blog with from blog to 
Reliable outreach mentions positioning unique URL 
Source # of reviews landing page 

# of views of 

online articles 


SETTING MEASURABLE GOALS AND OBJECTIVES 


‘Cheshire Puss,' she began, rather timidly, as she did not at all know whether it would 
like the name: however, it only grinned a little wider. 'Come, it’s pleased so far,' 
thought Alice, and she went on. ‘Would you tell me, please which way I ought to go 
from here?' 

'That depends a good deal on where you want to get to,' said the Cat. 

T don't much care where—' said Alice. 

Then it doesn't matter which way you go,’ said the Cat. 

'—so long as I get SOMEWHERE,,' Alice added as an explanation. 

‘Oh, you're sure to do that,' said the Cat, ‘if you only walk long enough." 


Without knowing where we want to “get to,” it is very hard to define the steps that we need 
to take to “get there.” Thus, goals and objectives are vital in setting direction, providing 
focus and defining priority. Without them we drift. It is like shooting arrows without 
defining or aiming at the target. 


= The Big Picture: PR objectives should support the goals of the company as a whole. 
An organization’s goals may include a combination of corporate growth, market 
share, sales, revenue, membership and donation increases, earnings per share, 
corporate reputation, social responsibility, innovation, employee retention and 
loyalty, etc. 


= The specifics: 


The Objectives Need to be: 


Relevant Do the objectives support the overall company/brand goals? 
Objectives must be directly aimed at what the business wants to 


accomplish. Anything not pertinent to that should be eliminated. 


Realistic Can I/we fulfill the objectives and what will it take to do so? The 
objectives should be attainable. There needs to be a belief that it is 
possible to achieve them, but at the same time that it is not too easy. 


Objectives should not be set too low. 


Specific Who do I want to affect with what? Objectives should be clearly 
articulated. They cannot be vague. It is not only the desired effect within 


a set time, but also considers the target audience. 


What measurements should I consider to establish success? The 
objectives need to be specific enough to be measurable and monitored to 
determine progress. Different objectives need different types of metrics. 


Measurable 


Timely Over what period of time am I/are we looking to achieve these 
objectives? Without a timeframe, it is possible to determine success but 


impossible to determine lack of success. 
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The benefits of goals and objectives: 


When clear objectives are in place, they: 


= Provide a focus and motivation for the team with everyone working toward the same 
outcome 


= Supply the foundation to the planning, underpinning the various activities 


= Aid in determining priorities to maximize the effectiveness and efficiency associated 
with each activity, so as to make the greatest impact 


= Determine success or failure - they provide the framework against which to be 
measured. 


The following Case Studies provide some examples of public relations programs in various 
industries that have had specific business challenges, successful programs based on clear 
goals and objectives, and measurements that demonstrate outputs, outtakes and outcomes 
results. In the end, you will see how this type of discipline can help you utilize 
measurement data to make business decisions to drive outcomes. 


CASE STUDIES 


Case Study One: Determining Which Tactics are Working or not Working 


The most frequent use of research is probably to determine which tactics are, or are not, 
working within a communications program, and by “working,” we mean contributing to the 
overall objectives in an efficient and effective way. 


Before it became part of IBM, Lotus Development introduced some 20 products during the 
course of the year. When it came time to plan for the next year’s product launches, the 
Director of Corporate Communications demanded to see tangible results from the previous 
year before allocating budgets. In order to determine what worked and what didn’t work, 
the PR staff gathered the 2,400 or so articles that mentioned Lotus during the previous year 
and analyzed each one to determine whether it left a reader more or less likely to purchase 
Lotus software, and whether it contained one or more of the company’s key messages. All 
articles were analyzed by a recent college graduate who was in the market for software. 


The results were revealing. The $350,000 launch of a word-processing product, complete 
with tons of shrimp in a very fancy party, generated a bunch of coverage, but very few of 
the resulting articles contained key messages. Conversely, a $15,000 press tour yielded just 
as much coverage, but with far greater inclusion of key messages. On a cost-per-message- 
communicated basis, the press tour delivered about ten times the value. 


Summary: 


= Business Goal: 

o Capture leading share of market in appropriate software categories 
= Communications Objective: 

o Communicate key messages through media coverage 
= Measurement Metrics: 
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o Outputs: Number of articles/impressions generated 

o Outtakes: Media acceptance of the product as measured by % of articles 
containing key messages 

o Outcomes: Lower cost-per-message communicated 

= Results: 

o Determined that the press tour was the most cost effective launch tactic. 

o Determined that problems with one program were due to individual PR 
manager, not weakness in program. 

o Final cost-per-message communicated: $0.25 for press tour and $3 for event. 


Case Study Two: Using Research to Win Support for Your Strategy 


At a major defense contracting firm, the use of spokespeople as part of a campaign to wina 
major defense contract was highly controversial. Traditionally, the company’s spokespeople 
had been engineers who were very media-shy. However, a competitive media content 
analysis of the leading business and trade press coupled with an investigation of contract 
outcomes showed a connection between the frequency and visibility of a company’s 
spokespeople in media articles and contract wins. Looking at the media content and 
visibility of each of the various players in the industry, they determined that the more the 
company’s spokespeople were quoted, the more likely they were to win the bid. As a result, 
the PR team had no trouble convincing its spokespeople to meet with the media, and the 
company embraced a proactive PR program. 


Summary: 


= Business Goal: 
o Win contracts 
= Communications Objective: 
o Position the brand as innovative and technologically superior 
= Measurement Metrics: 
o Outputs: Number of trade press articles 
o Outtakes: Media acceptance of client spokespeople as industry authorities: 
share of spokespeople quoted; share of favorable positioning on key issues 
o Outcomes: Win contracts 
= Results: 
o Went from last place in share-of-quotes to first in 12 months and increased 
share-of-quotes 10% to 70%. 
o Doubled visibility of brand in 12 months 
o A Significant increase in the number of competitive contracts won 


Case Study Three: Achieving Corporate Goals in Retail 


Some time ago, the J. C. Penney Company remodeled its leading stores in 31 major 
markets to attract a more upscale shopper. All markets were provided the same 
advertising, promotion and PR press packages, but the Dallas/Fort Worth market produced 
an unprecedented PR campaign called “Art Sunday at JCPenney.” The campaign was 
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comprised of four arts festivals, each benefiting performing-arts charities in the areas 
surrounding each store, and featured hundreds of performing and visual artists, runway 
shows themed “Fashion as Art,” sumptuous food and drink and celebrities such as Tony 
Bennett in the Southwest debut of his oil paintings. The events received terrific attendance 
and press, but did they meet corporate goals of impacting sales through a higher-income 
shopper? 


As is often the case, the answers lay down the hall in the accounting department. The staff 
was able to compare sales results for the three months following the Grand Re-openings for 
all other JCPenney remodeled markets against Dallas/Fort Worth. They learned that not 
only had the Dallas/Fort Worth market achieved the highest rates of sales increases in the 
country, but that credit card usage (which indicated a higher-income shopper) had doubled. 
This campaign received a PRSA Silver Anvil and IABC Gold Quill, and became a model for 
other JCPenney districts in the years that followed. 


Summary: 


= Business Goal: 

o Increase sales by X% in the D/FW District’s four modernized stores among 
upscale shoppers in the three month period following Grand Re-opening. 

= Communications Objective: 

o Meet sales goals by drawing an upscale audience to the four modernized 
stores through arts fundraising events and major media outreach. 

= Measurement Metrics: 

o Outputs: traffic counts; volume of media coverage; luxury vehicles at events 

o Outtakes: percentage of credit-card-use increases 

o Outcomes: % sales increases in the four D/FW stores as compared with the 
average increases of modernized stores in other markets 

= Results: 

o More than 10,000 guests were counted by store security passive voice; media 
coverage surpassed that of all other markets, and luxury vehicles populated 
all parking lots. 

o Non-jJCPenney credit card sales doubled, indicating achievement of attracting 
a higher-income shopper. 

o The D/FW stores greatly exceeded the rates of sales increases of all other 
modernized stores during the 3-month period following the event. 


Case Study Four: Measuring PR's Contribution to Sales 
Southwest Airlines routinely tests the tactics it uses before launching its presence in a new 


city. Typically it'll start with a word-of-mouth PR campaign - and will measure the number 
of inquiries as well as the number of reservations. They then schedule a major PR event, 
and again measure inquiries and reservations. After the PR has died down, they turn on the 
advertising and later direct mail and email outreach. At each stage, they measure the 
number of inquiries and the number of reservations to determine which tactic had the 
highest yield. They also incorporate unique URL’s into specific press releases to track actual 
ticket sales from people clicking on the press release. Thus, they are able to test the 
effectiveness of key words and phrases in each release in terms of generating traffic to 
www.southwest.com. 
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Summary: 


= Business Goal: 
o Sell more airplane tickets 
= Communications Objective: 
o Drive traffic to web site from press releases and media stories 
= Measurement Metrics: 
o Outputs: Number of articles 
o Outtakes: Awareness of Southwest service to the region; % increase in 
unique visitors to web site from PR site 
o Outcomes: Number of tickets sold 
= Result: 
o Over $40 million in ticket sales from press releases. 


Case Study Five: Improving Customer Service - A Catalyst for Change 


A major utility company was particularly concerned at the negative attention it was 
receiving in the media. This study spanned broadcast, print, online news, blogs and social 
networking sites as well as online forums. Management needed to assess the extent of the 
negative coverage, the areas to which it could be attributed and consider appropriate action 
to improve the situation. The PR team knew that this process was not going to deliver good 
news, but by quantifying how bad it really was, it became a catalyst for change within the 
organization. This is an ongoing work in progress. 


Summary: 


= Business Goal: 
o Improve company image 
= Communications Objective: 
o Isolate the damage of negative media attention 
= Metric: 
o Outputs: % negative coverage in relation to overall coverage and comparison 
of this coverage to positive coverage 
o Outtakes: Impact of negative coverage by area of attribution 
o Outcomes: Monitoring the outputs over time to track change 
= Result: 
o Customer Service was the major cause of negative coverage 
o The findings were presented internally and used on an ongoing basis to 
monitor performance and set improvement goals 
o Stories were developed to show a more personable side to the company 


Case Study Six: Using Competitive Analysis for Hospital PR Planning 


High Point Regional Health System in North Carolina built a major new cancer treatment 
center to increase consumer preference and market share in this key service line. 
Communications management knew increasing the hospital’s share of positive media 
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coverage would impact consumer preference, so planned a media outreach around the 
center’s opening and commissioned a Share of Discussion Study‘ of the hospital’s and 
competitors’ media coverage with drill-downs to key service lines. The client’s Share of 
Discussion scores were correlated against its bi-annual consumer preference survey, and 
market share was compared against that. As it turned out, the preference scores correlated 
very closely with the client’s Share of Discussion in key service lines such as Cancer 
(r=.97)°, and showed that the PR department was performing brilliantly against goals. The 
study’s on-going quarterly Share of Discussion reports enable the PR staff to monitor its 
performance in more than a dozen service lines, and to modify media and marketing 
outreach as needed. 


Summary: 


= Business Goal: 
o Increase market share through increased consumer preference in its cancer 
service line 
= Communications Objective: 
o Increase consumer preference by increasing the hospital’s Share of Discussion 
in cancer treatment 
= Measurement Metrics: 
o Outputs: Share of Discussion 
o Outtakes: Consumer Preference Study results; correlations of Share of 
Discussion scores to Consumer Preference Study scores 
o Outcomes: Market Share 
= Results: 
o Share of Discussions scores for cancer increased during grand-opening 
o Correlations between Share of Discussion and Consumer Preference Study 
results were r.=.97 (Pearson Product Moment Coefficient) 
o Consumer Preference Study scores for cancer increased approximately seven 
percent during the corresponding period with a six-month lag 
o Market Share for cancer increased 5.8% for the corresponding period with a 
nine to twelve month lag 
o On-going analysis reveals both success and challenges in cancer and other 
key service lines each quarter 


CONCLUSION 


This paper is meant to be an idea-starter on how public relations professionals can utilize 
research to demonstrate their ability to truly affect organizational outcomes. The 
Measurement Matrix in the following Appendix provides additional ideas on how to mix and 
match various measurement techniques to ensure you are collecting the right kinds of data 
from which to make decisions. 


For additional resources, visit the Institute for Public Relations Commission on PR 
Measurement and Evaluation website at: www.instituteforpr.org. 
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APPENDIX 
The Measurement Matrix’ 
Business Outgrowths to 
Goal or PR Objectives Outputs to Measure M Comparing to Outcomes 
per easure 
Objective 
Increase Media analysis on Surveys before and Benchmark and graph 
awareness quantity, quality and after program to help numbers of leads, prospects 
Increase reach of coverage; establish link between or customers before, during 
preference attendance at special outputs and awareness, | and after campaign. Get 
Stimulate trial events; numbers of preference or intent; paid-media schedule and 
speeches given. consider omnibus or plot along with non-paid 
s Increase media Consider using Internet surveys if cost | media efforts on a calendar 
ales of He E ; : 
Products recommendations | Efficiency Metrics like is an issue; track spreadsheet, and overlay 
Cost-per-Impression, responses to messages | with sales data (offsetting 
anp belie Cost-per-Media Val through sal for sal le) and look f 
Services pütchassinisni ost-per-Media Value rough sales or sales cyc e) and look for 
Ratio, or Cost-per- departments, call- correlations. You should see 
Message. centers (establish 800 more spiking from non-paid 
numbers for specific media versus paid-media 
releases), or web visits | efforts. OR - consider 
(specific URLs). correlating media efforts 
with sales goals through 
Share of Discussion. 
Increase Share of | As above, but focus As above. Surveys will | As above. Obtain Market 
Discussion mainly on competitive help establish the link Share data from Marketing 
hcreaseshare-of media analysis on share | between your output or Sales; plot on graph and 
message of overall coverage, key | measures and whether overlay your share 
message, positive and or not the audience is measures against it. Also 
Increase share of | negative, media moving toward consider services such as 
positive coverage | recommendations, key behavioral objectives. Brand Keys and Loyalty 
Increased Increase share of | spokesperson quotes. Consider CGM or WOM | Builders to establish more 
Market journalist Also track numbers of analysis - looking for in-depth customer analysis 
Share recommendations | customers at the trends in positive before and after event, and 
beginning and end of internet discussion and | try to correlate. 
Increase share of | the campaign. recommendations. 
quotes 
Increase positive 
opinions among 
current customers 
Reinforce brand Media analysis focused | Unaided awareness As above, plot efforts 
Enhanced | characteristics on messages of value survey before and after | against sales. Consider 
Brand Increase and brand character; campaign to see if getting average revenues 
Equity perception of competitive analysis if audience can play-back | per-sale, and see if they 
value possible. your messages. have increased. 
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The Measurement Matrix’(Continued) 


Business Outgrowths to 
Goal or PR Objectives Outputs to Measure M Comparing to Outcomes 
H easure 
Objective 
Increase Media analysis focused | Do focus groups or Compare efforts to survey 
alignment on messages of surveys using Dr. results, and to 
between desired importance to each Grunig's paper at increased/reduced CGM 
reputation and stakeholder audience; www.instituteforpr.com and WOM messages 
Enhanced audience positive/negative letters, | on attitudes toward: received. 
Reputati perceptions emails and CGM/WOM | Control Mutuality, 
putation ; ; ; 
Improve strength messages received. Satisfaction, Trust, 
of all relationships Commitment, Exchange 
- and prioritize. Relationship, 
Communal 
Relationship. 
Reduce negative Real-time media Omnibus Studies, Plot media measures, tours, 
Mitigate impact of crisis on | analysis focusing on overnight polls and public meetings, etc. on l 
Crisis: perceptions of the | message and tonality. CGM/WOM content chart with sales, stock price, 
Opti Hi firm Do media audit on analysis to determine and positive/negative index 
ptimize . : . f 
Stock Price published pieces attitudes, perceptions. for CMG/WOM. Of course, 
created for the crisis. benchmark these at the 
Were messages clear? beginning of the crisis! 
Reduction in For employee outreach, | Run internal survey on Plot output measures 
turnover and do media audit of attitudes via website against benchmarks such as 
better customer internal efforts to before and after turnover rate, customer 
service communicate against employee campaign; or | service ratings, average 
specific PR objectives. monitor blog chatter for | cost-per-sale; last year's 
Measure external efforts | changes in tone; hop cost of communications, etc. 
in ways mentioned onto marketing (Data is available in 
above. department surveys for | marketing, sales and 
metrics on attitudes, finance departments). Use 
WWepease Decreasing cost preference or intention survey or CGM information 
Profitability | Per sale to buy for external to verify receipt of 


Decreasing cost 
of 
communications 


audiences. 


messages. Find out costs of 
hiring/training a new 
employee, or cost of 
acquiring a new customer in 
your industry, and translate 
to how much money the 
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